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Abstract 


In this paper, the geometric distribution is considered. The means, vari- 
ances, and covariances of its order statistics are derived. The Fisher infor- 
mation in any set of order statistics in any distribution can be represented 
as a sum of Fisher information in at most two order statistics. It is shown 
that, for the geometric distribution, it can be further simplified to a sum of 
Fisher information in a single order statistic. Then, we derived the asymp- 


totic Fisher information in any set of order statistics. 
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1 Introduction 


The geometric distribution with parameter @ is given by the probability mass 


function (pmf) 


{@0=— 1 =]=00*, t= 051,25. 5 0 eo <1, (1) 
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In general, the distribution theory for order statistics is complex when the parent 
distribution is discrete. However, order statistics from a geometric distribution 
exhibit some interesting properties. The geometric distribution possesses several 
properties (like lack of memory) of exponential distribution. Due to the relation- 
ship between the geometric and the exponential distributions, there also exists a 
close relationship between the dependence structure of order statistics from a ge- 
ometric distribution and those from the exponential distribution. To this end, we 
may first note that when Y has an exponential distribution, i.e., it’s probability 


density function is given by 
1 
flysd) = ye", y> 0, ADO. (2) 


then X = [Y], when [.] stands for integer part, is distributed as geometric 
with parameter 9 = 1—e!/A. Also, the geometric distribution is the only 
discrete distribution for which the first order statistic and the sample range are 
independent [2]. 

The Fisher information plays an important role in statistical inference in 
connection with estimation, sufficiency and properties of variance of estimators. 
It is well known that Fisher information serves as a valuable tool for derivation of 
variance in the asymptotic distribution of maximum likelihood estimators (MLE). 
For a random variable X, discrete or continuous, which pmf or pdf is f(x; 6), 
where 9 € © is a real value and © is the space parameter, the exact Fisher 
information contained in X is defined as 


eee By ean) | (3) 


Tx(6) = E( 
x9) a0 020 
under certain regularity condition (see [7]). Let X;, 1 = 1,...,n be a sample 
from Ff, the exact Fisher information about @ in any k order statistics, Xp... < 


Aap Se Aen Lr fos < re Ss 1, 18 defined. as 


O 2 
Deven eG) = B{ = log feauiwale)} ; (4) 


where friry...rz:n(9) is joint pmf or pdf of (Xp,:n,Xron,---Xrz:n)- The problem 


of obtaining the Fisher information in order statistics was described in [2] with 


Asymptotic Fisher information in order ... 


the words: “while the recipe for Iy(@)is simple, the details are messy in most 
cases” where Y is an arbitary collection of order statistics. Several results have 
been published in this direction in recent years. For example, Mehtoria et al. 
[8] presented the Fisher information in the first r order statistics. Park [9] used 
an indirect approach to obtain the Fisher information in r order statistics, and 
presented very information plots to demonstrate which order statistics have more 
Fisher information. Zheng and Gastwirth [14] calculated the Fisher information 
contained in any collection of order statistics. Abo-Eleneen and Nagaraja [1] 
studied the Fisher information in collections of order statistics and their con- 
comitants from bivariate samples. Park and Zheng [12] derived a necessary and 
sufficient condition under which two distribution have equal Fisher information 
in any set of order statistics. Hofman et al. [6] used the Fisher information in 
minima and upper record values for characterization of hazard function. Park [10] 
considered the optimal spacing based on the Fisher information. Park and Kim 
[11] considered the Fisher information in exponential distribution and simplified 
the Fisher information in any set of order statistics to a sum of single integrals. 
In other application, such as life testing surveys (see [3]) and optimal spacing (see 
[4] and [10]), the asymptotic Fisher information is used. 

The rest of the paper is organized as follows. In Section 2, the means, vari- 
ances, and covariances of geometric order statistics are derived. We derived 
the asymptotic Fisher information about @ contained in the rth sample quantile 
(Xp-n) of geometric distribution in Section 3. In Section 4, we provide the simple 
method for obtaining the Fisher information and asymptotic Fisher information 


in any set of order statistics of geometric distribution. 


2 Calculating means, variances, and covariances 


Since the Fisher information is related to the variance-covariance matrix of the 
estimate of 7, being its inverse under certain conditions, we derive variances, and 


covariances of order statistics come from a geometric population. 
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Let Xj,...,X, be asample from (1) and denote the corresponding order statis- 
tics by Xin < X2Q:n Suns Xan: 


2 


Lemma 2.1 Let pyp.n, and o7.,, and Or,5:n be mean of Xpin, and variance of Xpn, 


and covariance of Xp. and Xg., respectively. Then, we have, forl<r<s<n 


£ gr-j+l 
Lrin = S> [—9n-s41’ (5) 
j=0 
- 
gr—-sit1 
2 
Prn = 2 (1 — 9r-J+1)2? (6) 
j=0 
and 
Or,s:n = Or : Cr) 


Proof. Under the transformation Z; = (n—-i+1)( Xin —Xi-1-n) for i = 1, 2,...,n, 
one can see that the variables 7), Zo, ..., Z, are independent random variables and 
pmf each of Z; is given by (see [2]) 

EO) = Sole 2S et 1 Or Ss (8) 

The equivalent transformation can be written as 

Z; 
A = SS 9 
Sa eeress (9) 
j=0 
From (8) and (9) we immediately, conclude that 


is gr-s+l 
rn = D0 ges 
j=0 
- : 
gn—-stl 
2 
a - _ gn—jtly2? 
and 
r , 
gn—-sit1 
Or,s:n = S- (1 — 97-3541)2° 
j=0 


We may similarly derive the higher-order moments of X;7., if needed. 
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3 Asymptotic Fisher information in the rth order 


statistic 


Definition ([13]) Assume + — p; (for i=1, 2, ..., k) as n + 00, where 0 <p; < 
po <.. <p, <1. The asymptotic Fisher information about 6 contained in k 
sample quantiles (X7,:n,Xroin;--Xr,:n) , denoted by Ip, po...p, (A), is defined as 


‘ 1 
Lins 20) = lim — Tp yrg...ry:n(8), (10) 


noo nN 
which can be written as (({13]) 
k ’ 2 
iepnei®) = eal ie spfloiP)ae : (11) 
where pp = 0, py+1 = 1, and £ = F~!(p;8). 
The asymptotic Fisher information in a single order statistic can be obtain 
rapidly by substituting /& = 1 in (11). Thus, we get 
1 & 9 : 
hi) = af Sree) (12) 
In what follows, we find the asymptotic Fisher information in a single quantile 
of geometric distribution. From (1), we have F(z;0) = (1—07*") so F-!(p;0) = 


(tog) —1). By (12), Z,(@) for geometric distribution can be calculated as 


log 0 
follows 
i; &p r) 2 
WO = say Deal} 
Ep 2 
= 1 x c—l £ x 
Terie : +00} 
1 log. =p)  p2[ tot) _ 4] 
pla ee) pe as 


where |-], denotes the integer part. 


Remark 3.1 By using (13) for geometric distribution, we can approximate the 
Fisher information contained in X>.n, about @ by nothing that Ip.n(0) ~ nI,(@) for 


large values of sample size and r <n as follows 
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3 


Nn log(n — r) — log(r) 2 of etnsn) lost) _ 
Irn(8) & eenranen =e 1) 6° i . (14) 


4 Asymptotic Fisher information in k order 
statistics 


Park [10] has shown that the Fisher information in any set of order statistics can 


be written as 


k k-1 
Inirsnren( 0) = S> de ten) e S- Fan lO), (15) 
= = 


where 0 < ry < 19 <1... << ry <n. We will show that it can be further simpli- 
fied to a sum of Fisher information in a single order statistics while the parent 


distribution is geometric. 


Theorem 4.1 Jf the random sample comes from a geometric population, then 


k 
Irieaaean Oy = SS Eternia @) (16) 
t=1 
where ro = 0. 


Proof. The proof follows by using the lack of memory property of the geo- 
metric distribution. As it has been shown in [2], X;,:. — Xr,_,:n is distributed as 
Xp, —r;_1:n—r;_, 1n geometric distribution, (X;,:n, Xrg:nj +) Xry:n) and (Xpy:n, Xrain— 
A ay heya ay) ate equivalent statistics and (Xp, ay Xeon Ari te 
Xr,_,:n) are independently and geometrically distributed, therefore the proof is 


completed. 


Theorem 4.2 If the random sample has geometric distribution, then 


1-pi log( 1—Pi 


Ioxpo..ny(8) = 3 pin (Se | 1) earl 


— (1 — pi) (pi — pi-1) log 
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Proof. By using (13), the asymptotic Fisher information of [,,-;,;_,:n—r;_,(@) can 


ak 
1—pi-1 


be written as 


Theorem 4.1. 


Ip;-»;_, (0). Thus, the the proof is completed by considering 


1—pj_-1 


Remark 4.1 By using (17) for geometric distribution, we can approximate the 
Fisher information contained in (Xpy:n;Xro:n;---Xr;,:n) about 6 by nothing that 
Tr yro.rpin(O) & NL pypo...p, (9) for large values of sample size andr; (fori =1,...,k) 


as follows 


NAT; los( a) 


Pane) = Ss Ee {Ree a) ole, 


whereO < ry <1ro <0. << rp <M. 
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